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ABSTRACI . . • 

One of the la ior assuaptiocs of recent rea^ng . 
research has beoa that what the reader sees in the text plays as 
heavily in deteriaing conpreheT^sid.^' a s does what the author says in 
the text. Although BDst researchers have tended to iLfer the reaiier's 
contributions by .opting the differenced between text structure aid 
recall structures, there have been efforts to develop tools to 
quantify what the reader sees in thz taxt. These effpr'ts began with 
attentiOQ to a text's forwal structure as the reader sees it and to 
the world knowledge of the reader oresuned by the text. Pour 
•behsvidral aeasures have been proposed for approaching text as a 
product of readers' perceptions: hatinq readers niark' off "idea units" 
in_tbe— t ^ x t Iv de tereine where and how readers organize texts: "rating 
these iiaa units as iaportant/unlaportant to the aathor's^ aain 
points: recording the ianediate tecalls of what has been "read; aid 
rating the iaportance of propositions ensuing frola' dependency 
analyses. Research depender.t on these measures has\ begun, using 
collega students as "exvert readers"; and the intetrej.atic»nships . 
aaong the date suggest interesting connections between the Banner in 
which students perceive text structure and the stru<^ture of. their 
comprehension. (RL) \ 
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. Uomprehension: Of What the Reader 
Sees of What the Author Says 
* Thomas H. bstes and Wayne L. Shebilske 
University of Virginia 

This paper derives from an NIE/NSF jointy funded 
project designed to develop some basic understandings , 
concerning the relationships between the conceptual 
structure of textbooks and the quality and processes 
of comprehension. Many students have difficulty 
learning from the textbooks of content courses, 
though sometimes the students are otherwise seemingly , 
good readers. At least >two plausible\^explanation3 
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mfght be offerred for this. For one, it is possible 
that most of the materials in^which student have 
learncrd to read possess a narrative structure, while 
those in which they are now asked to read to learn 
are characterized by an expository structure which 
makes different demands on the reader. After sev- 

eral years of being taught to reai in anthologies of 

■ « ■ . 

stories, students may have tacitly internalized 
"grammars" for stories, strategies of cpmf^rehens ion 
not dissimilar in principle from those which re- 
searchers such as Rummelhart (1977) have explicated 
^.n the form of narrative rules. The expository and 
|quasi-technical writijig in text books, particularly' 
at^upper grade levels, may not easily yield to such 
rules . 

Another explanation is that the world knowledge 
demands placed on students by their content area 
reading are prohibitively great. Narration, with 
its major purpose of effect rather than information, 
would seem to make relatively fewer su^h demands. 
If so, this might arg^ue for its choice as the style 
for teaching very young readers, but the question 
remains, how are students to understand the more 
difficult expository form of textbooks whose major 
purpos'e is to inform. Our working hypothesis is 
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that. the answer to this question will be found 
in an explication of what Walter |Cintseh (1979) 
has called an "interact ionist" view of reading.. 
Oiir hope is to '^contribute to this explication. 

The base of research frojn which one begins to 
investigate the process of comprehension is quite 
^ solid. Two particular features characterize re- 
search in comprehension and retention of prose in 

this decade and distinguish.it from previous work. 

. \ 
The last ten years have witnessed a change from sur- 
face structure analysis of text to the analysis of 
semantic structure, concomitant with a switch to 
open-ended or minimally cued recalls in preference 
to answers to specific questions as a measure. of- 

t 

comprehension (cf. Marshall 6 Glock^ 1978). These 
shifts reflect a widespread view that there are (1) 
identifiable structures of text, generally specificable 
in prepositional terms, and C2)-6tructures of thinking, 
hypothesiied about in relation to cognitive struc- 
ttjre (Ausubel, 1968) and schema theory (Anderson, 
1976), which both have an effect on comprehension 
and, indeed, may together play a determining role 
with respect to comprehension. One of the major 
assumptions to which this leads is that what the 
reader nees in the text plays as heavily in determin- 

I 
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ing comprehension as does what the author Sjiys 

.in the text. In philosophical terms, this idea is 

congruent with the phenomenological perrspective ^ 

on reading advanced most recently and perstiasively ' 

by Wolfgang Iser in his book, The Act of Reading 

(1978): . . the study of a literary work should 

concern not only the actual text but also, and 

in equal measure, the actions involved in responding 

to that text " pp. 20-21. (For a briej^jp-and 

easily, apprehensible discussion of Iser's 

ideaii see Iser, 1974^ or Iser, 1971.) 

Much notable fecent research has rested on 

ideas similar to these (Thorndyke, 1977; Rummelhart, 

1977; Kintsch and Van Dijk, 1976; Frederickson, 

1975). In general, however, most researchers 
have sought to infer the contribution of the . 

reader by looking for differences between the 

structure of text and the structure of recall.. 

One of our major attempts to extend this Tine of 

inquiry will be to develop tools to quantify 

* 

what the reader sees in the text. We seek to 
advance the operation of text analysis by giving 
it the power to account as directly as possible 
for the contribution of the reader to the 
structure of text. Though we are utilizing for- 



Estes 5 ShebiXske 

• ^ ' . ■ • . . 5 

mal analyses of text structure, the emphasis' of 
our research is on the structure of text as 
readers perceive it. 

Our work has begun with textbooks in science. 
We have specified in propositiOnal terms the formal 
structure of e.xcerpts from three biology text- 
books, one at t:he seventh grade level, one at | 
th^ t,enth grade level, and one at the college ■ 
level, all concerned with the classification of 
species. CWe have employed a dependency analysis 
Proposed -by Deese (1979) which yields 
a propositionally-based hierarchical explication^ 
of text.) From these analyses, two important 
though not unexpected findings \ have emerged. 

First, the passages differ in their depth. The 
seventh grade passage has no proposition deeper 

than the sixth lev^l. In contrast, the tenth grade* 
passage has propositions as deep as the twelfth 
level. Second, the .^exts differ in the extent to 
which they demand inferences on the part of the 
teader, the , extent to which- information is pre- 
sented ambiguously, and the extent to which the 
organization of the presentation, follow^^ln in- 
ductive or a deductive path. For example, the 

s\'bsection of the tenth grade text entitled 

/ 

"Meaning of species" begins with a particular 

6 
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example, the **many intermediate mongrels between 
such different breeds as Gr^at'Danes and grey- 
hounds", the first paragraph ends, "Therefore, 
all dogs are grouped into a single species." The 
full section ends with a one sentence definition of 
species as its summary. The general projblem of 

speciation is buried in the text and in the hier- 

■1 

archy of proppsitions which describe it. Other 

sections, are even more extremely inductive, and 

th? reader is often left to infer very major ideas. 

These show up as parenthetical proppsitions in the 

formal analysis. By contrast,- however, the cor- 

respondingVection of the college text, entitled . 

"What is a species?", begins with a definition. 
Similarly, other sections tend to begin immediately 

with general principles, and thus t^e organization 

of the text is such that the topical statement is 

formed of very high 'order propositions. Exactly 

how this may effect what the reader sees in the text 

is one of our major questions. In technical terms, 

this relates to the grammars assumed by different 

•expository structures. 

bur formal analyses are also directed at the 

problem of w(/rld knowledge presumed by text.' Though 

lower level texts' typically have less depth of • • 

structure than higher level texts, this is not 
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invariably so. For example, the excerpts on the 
classification of species are atypical because the 

* 

excerpt from the college text has a shallower 
structure than the excerpt from the tenth grade text. 
Yet our intuitions suggest that the college excerpt 
is actually more complex to understand. The be- 
ginnings- of an answer to this enigma are. found in 
consideration of the part of the specific body of 
knowledge presented by each text. The college text 
relates the notion of species to the theory of 
evolution; the tenth grade text does not, the 
authors having chosen to treat evolution^as a 
separate topic. , Hence, the information presented 
in the college text must be related by the reader 
to a larger conceptual structure which is mostly 
assumed by the author. The difference between the 
two texts, is no simple matter of sentence complexity, 
word frequency, or even propositiorial content. It 
is rather, at least in part, a matter of what we 
might call "textual presumption", the relationship 
between the conceptual structure of each text and 
the structure of an entire body of knowledge about 
biological classification. It is. part of our goal 
to adopt the use of formal analyses in a manner 
v/hiph allows us to capture this important conceptual 
feature of texts. 

8 
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The complement to these formal, measures of 

text properties^, and the dimension of our research 

allowing an approach to text as a product of 

readers' .perceptions, thus far. has taken the form of 

f pur interrelated behavioral measures. Initial 

data were drawn on college subjects; similar measures 

are currently being taken on students at seventh 

and tenth grade levels. The. data reported here 

were, derived from college students' reading of 

our /Tenth grade passage. College students have 

served, in effect, as\ expert readers and it is 

from data drawn on their reading of the tenth 
grade text that we expect to drive hypotheses 

concerning other students' reading of materials 

appropriate to their grade placement. These are 

our four measures: One, we have asked students 

1 ■ 

to mark "idea units" in the text and we lhave 
analyzed these markings to determine where the 
texts divide into such units. Two, we hiave asked 
a group of studenti to rate thesi§ idea units as 
important or unimportant with respect to the author's 
main points. Three, we have asked a group of ^ 
students to read the p^^ssage and to record- ira- 
jnediately their recall of wlvat they read. And, 
four, we ]iave asked a group of college students 
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to rate the importance of the propositions en- 
suing from our dependency analysis with respect » 
to the author's central message. Interrelation- 
ships among these d/tai suggest interesting con- 
nections' between -.the manner in which student si^ 
perceive and act on text structure and the 
structure of their comprehension. 

^One immediately interesting finding is that 
formal and behavioral measures may differ in the 
picture of text they afford, /ny formal analysis 
musjt be specificably and predictably rule governed, 

by definition, and in that degree it must be rigid. 
Behaviors of readers, jthoughiV are governed 

by more flexible rules, rules which are tacit and 

unspecifiable in principle. This can result, for 

example, in some high level propositions b^ing . 

given low importance ratings and in some low level 

propositions being given high importance ratings. 

Most obviously, this occurs when good readers per- ' 

ceive the importance of subsidiary propositions 

/I 

which are main ideas. 

Our pv^edure for determining thfe idea units 
in a text are interestingly simple but complexly 
justified mathematically (Rotondo, 1979). Basically, t 
problem we faced was m knowing how many idea units 
passage contained and where the breaks between 
units came. To answer the first question, we 

10 




Estes ti Shebislce 
10 

relied on the arithmeti-c mean of idea unit marki 
which subjects used'.. ^That is, our bestr-^ticss of 
how ttany ideas the text contained was the average 
number- of idea's marked. To ariswer .the second 
question, we calculated the percentage of subjects 
agreeing on each- possible idea unit break, ranked 
the possible' brVjttks on that basis, and then merely 
counted off the number of ideas our. a* ve raging had 

told us exist in the passage. 

' • \ ■ 

A hypothetical example might serve to clarify 

\ . , ■ • . 

these. procedures. Assume a passage of narration 
on a certain topic such as a chapter from a text- ! 
book. Assume further' that a ^roup of 100 readers , 
is asked to read th^ passage ahd to place a slash 
•mark at each, poiot where they think one idea ends 
and another begins. Different readers will have 
different ftumbers of idea units thus marked, 
n^t^rally.. But thei bes't estimate of how many ideas 
units>T0bably exis't in the passage is the average., 
number of .units the 100 readers chose. Say the 
average numier of ideas marked in this p;assage is 
20.. The question remains, which are the\ "actuaV' 
20 which the passage contains? The answer is, 

those the IQO readers. had the highest agreement on. -j 

\ - . ■ 

Which possible place for a slash mark was idlest 
frequently cljosen? Next most frequently? And so 
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on, ^until the 20 most frequently chosen-idej^units 
are determined. The hypothetical passage is' now. 
di'Vided into^dea^units based on readers' percep- 
tibns. The procedure is elegantly simj^le and' lets • 
us describer,the idea unit constituents* of any, tex:t 
based on i a group of readers* perceptions. . This~, 
represents a major purpose of our jresearch which, 
we will coi^tinue to refine in practice! . 



Our first ^majot research Question ha sy. concerned 

the relationship between the importance r'^tlng of . •• 
individual idea units and the likelihood of their * 

inclusion in- the-rec-alls of students, who re'ad the ,\ 

passage. As on,e iq^ght expect, we f^d a substantial* 

and significant corelation between;.i|nportance''>ijd 

recall of an idea (r »'0.39, p < .O^llj; This ac- 

counts, however, for only 16^ of the variance, leaving 

us to conjecture about the other 84^. We. are particularly 

interested in two kiads of deviations: 1 J N^students' 

failing to report what they know' to be important and 

2) stude-nts tending to report what they know to be 

unimportant. We are now catalogijig aspects of the text 

and aspects of students' approaches to the text that 

seem to be related to these two anomalies. We are 

•phrasing our coi;ijectures in the form of hypotheses 

which we think, The tools and procedures we have 

develone/l wiilisoon allow yis to test. 
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